James-Stein type estimator by shrinkage to closed convex set with smooth boundary
نویسندگان
چکیده
We give James-Stein type estimators of multivariate normal mean vector by shrinkage to closed convex set K with smooth or piecewise smooth boundary. The rate of shrinkage is determined by the curvature of boundary of K at the projection point onto K . By considering a sequence of polytopes K j converging to K , we show that a particular estimator we propose is the limit of a sequence of estimators by shrinkage to K j given by Bock (1982). In fact our estimators reduce to the James-Stein estimator and to the Bock's estimator when K is a point and a convex polyhedron, respectively. Therefore they can be considered as natural extensions of these estimators. Furthermore we apply the same method to the problem of improving the restricted mle by shrinkage toward the origin in the multivariate normal mean model where the mean vector is restricted to a closed convex cone with smooth or piecewise smooth boundary. We exemplify our estimators by two settings, one shrinking toward the ball and the other shrinking toward the cone of non-negative de nite matrices.
منابع مشابه
Shrinkage to Smooth Non-convex Cone : Principal Component Analysis as Stein Estimation
In Kuriki and Takemura (1997a) we established a general theory of James-Stein type shrinkage to convex sets with smooth boundary. In this paper we show that our results can be generalized to the case where shrinkage is toward smooth non-convex cones. A primary example of this shrinkage is descriptive principal component analysis, where one shrinks small singular values of the data matrix. Here ...
متن کاملOn the degrees of freedom in shrinkage estimation
We study the degrees of freedom in shrinkage estimation of the regression coefficients. Generalizing the idea of the Lasso, we consider the problem of estimating the coefficients by the projection of the ordinary least squares estimator onto a closed convex set. Then an unbiased estimator of the degrees of freedom is derived in terms of geometric quantities under a smoothness condition on the b...
متن کاملApplications of James–Stein Shrinkage (I): Variance Reduction without Bias
In a linear regression model with homoscedastic Normal noise, I consider James–Stein type shrinkage in the estimation of nuisance parameters associated with control variables. For at least three control variables and exogenous treatment, I show that the standard leastsquares estimator is dominated with respect to squared-error loss in the treatment effect even among unbiased estimators and even...
متن کاملApplications of James–Stein Shrinkage (II): Bias Reduction in Instrumental Variable Estimation
In a two-stage linear regression model with Normal noise, I consider James–Stein type shrinkage in the estimation of the first-stage instrumental variable coefficients. For at least four instrumental variables and a single endogenous regressor, I show that the standard two-stage least-squares estimator is dominated with respect to bias. I construct the dominating estimator by a variant of James...
متن کاملBias Reduction in Instrumental Variable Estimation through First-Stage Shrinkage
The two-stage least-squares (2SLS) estimator is known to be biased when its first-stage fit is poor. I show that better first-stage prediction can alleviate this bias. In a two-stage linear regression model with Normal noise, I consider shrinkage in the estimation of the first-stage instrumental variable coefficients. For at least four instrumental variables and a single endogenous regressor, I...
متن کامل